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ABSTRACT 

Using enrollment decline cases for data, the case 
survey method analyzes the content of case studies, thus allowing 
data from various cases to be aggregated and researchers to overcome 
constraints on data collection. The analyst uses six steps in this 
method in reviewing the case literature: (1) definition of the unit 
of analysis, (2) identification of case search strategy and case 
sources, (3) actual case search and selection, (4) checklist 
development, (5) checklist application to the cases, and (6) data 
analysis and interpretation. For enrollment decline, the unit of 
analysis chosen was that of case literature written between 1971 and 
1980; the identification of case studies involved 10 sources, 
including journals, dissertations, and research suggested by 
scholarly organizations. Seventy representative cases were chosen and 
a checklist of 227 variables was prepared for application to the 
cases. Conventional statistical techniques were then used to 
determine the relationships between variables of interest to the 
researchers, including questions about the relationship of enrollment 
decline and school closings and the impact of declines on per-pupil 
costs. Although refinement is needed to ensure validity, adequate 
data, representative samples, and consistent application of 
checklists, the case survey method can successfully integrate 
fragmentary case studies and combine qualitative and quantitative 
methods of research. (JW) 
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STAYING ENR 0L LME\>t DECLINE 
(AfoD OTHER TIN 1ELY ISSUES) 
VIA THE C ASE SURVEY 



subject of this pape r is 3 technique to integrate several isolated 
c a.se s tudies. It * as cro a ted, almost by necessity » a s a result of U'o 
p rot? lei Hs which often piag ue e ducati°n.al researchers: constraints on data 
c oll ec ^ion and the P r olif eratio n of one.shot case st udies. Each problem 
*U> b * discussed l^iefly. 

educational ^sea^chers to study a controversial issue, the 

implantation of * new technique, °r the impact of a n ew policy, ^ey are 
oft* n Constrained W a number of * act °rs . In school closings, for example, 
it i 5 Possible that the Co st of collecting data over the duration of the 
dec> s Hn-making process w iU be pr° h ibi t ive. Second, acceS s to the various 
p art ic ipants may b« P r obl ematic . Pe °Ple move awaY' boards go into execu- 
tive H S si 0 n, and subject^ ma y ref" s e t 0 cooperate- Finally, it is often 
diff ic Mt to concede a quasi -experimental or experimental design- Imagine 
a re S6 archer who w» n ts t 0 study effects of a comm Unity involvement 
poli cy on the clos^e de cisi on. researcher c^uld not a sk the school 

boa^ to use a com^ity taslc force in one part of th e district to recommend 
5 ch0°ls f0r cl0SU r e ' and prohibit c °nunu n ity inVolV«»ent in another p art of 
the di stri c t. 

til Ught 0 f t^ e se constraints, researchers often rely on the inten- 
sive C ase study. The rae t h od usual** includes partici pant observation, 
-^pe^ded interviews, a nd s ituati°n-sp ec if ic doc^ents to describe the 
eve* ts and to form ^ali tative contusions about t h e policy phenomena in 
que^on. In the » r ea o* enrol lm ent decline, for e Xam p i e , case studi eS 
pxcJ^erate the l» nds cape (see Col* 01 * and French, 1 9 ?9; Cuban, 1.979; Du ke 
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and Meckel, 1980; Rogers and Nord, 1981; Wachtel and Powers, 1979; 
and Yeager, 1979). 

Case studies have several advantages over experiments. First, 
they offer detailed accounts of a particular phenomenon. Moreover, their 
longitudinal nature allows the description of events over time. Third, 
cases 0 ffer close-at -hand. impressions of the case writer which may be 
more accurate than impersonal surveys which ask for a rating on a number 
of quantitative scales. Most important, case studies overcome the cost, 
access^ ^d design constraints of quantitative research. Thus, for many 
policy questions, intensive case studies may be ideal, and often become 
the dotou nan t mode of research. 

On the other hand, numerous case studies can be a curse (Wilson, 1979). 
The Various "war stories" are too idiosyncratic. They describe what 
happened in one situation and generalization to, other settings may be 
limited. While researchers know it is important to review and integrate 
previous research before they pursue a topic, the presence of diverse case 
studie s makes it difficult to know exactly what the case study literature 
say s - As the number of case studies on a certain topic grows, it becomes 
increasingly important, however difficult, to integrate their collective 
meaning. 

In his Presidential Address at AERA in 1975, later published in the 

Edu£gtional Researcher , Glass (1976) underscored -this very point: 

The literature of dozens of topics in education is growing 
at an astounding rate. In five years time, researchers can 
— produce literally hundreds of studies on IQ and creativity, 

or impulsive vs. reflective cognitive styles, or any other 
topic, (p. 3) 

Our problem is to find the knowledge in the information. We 
need methods for the orderly summarization of studies so that 
knowledge can be extracted from the myriad of individual 
researches, (p. 4) 
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This is not to suggest that synthesis of multiple case studies does 
not occur. Qualitative syntheses in the area of enrollment decline were 
done by Rideout (1975), Burlinganie (1979), and Boyd (1979). These 
scholars have taken an important step, and while the number of cases they 
analyzed was usually small (6-10), their efforts were critical to the 
integration of diverse case materials. 

The purpose of this paper is to describe a more extensive technique 

for dealing with the twin problems of constraints on data collection and 

v. 

the need to integrate many case studied. The technique is called the 
case survey and involves the analysis of . the content of case studies via 
a closed-ended questionnaire. This instrument enables the researcher to 
aggregate the various case experiences and, in turn, to make generaliza- 
tions about the studies as a whole. After outlining the roots of this 
approach and its relationship to irsta-analysis, the discussion turns to 
a description of the basic process with an application to the enrollment 
decline case literature, and discussion of implications for future edu- 
cational research and development. 

ROOTS OF THE CASE SURVEY METHOD 

The case survey method attempts to carry many isolated case studies 
several steps forward by systematic aggregation and analysis. The 
origins of the approach can be found in content analysis, and more recently, 
in the efforts of a handful of organization researchers. 

The content analysis of published data is not new in social science 
"research. It has been used in history, journalism, anthropology., and 
sociology for many decades (see Berelson, 1954; Budd et al., 1967; Carney, 
1972; North, 1963; and Pool, 1959 for several classic examples). Essen- 
tially, it involves the coding* tabulating, and analyzing of existing data. 
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Coding categories may include (1) the number of occurrences of an event, 
(2) the presence or absence of a phenomenon, (3) the attitude toward an 
object, and (4) the intensity of feelings about a role. 

Erail Bend's study (1952) is an excellent example of content analysis. 
He investigated the spouse-wanted columns in a New York Yiddish newspaper 
called The Day . This paper regularly published a classified spouse-wanted 
column; interestingly, tlnr form of spouse selection was considered quite 
acceptable until the early 1950 f s. A typical ad read, "Parents seek a 
physician for pretty daughtei." Bend compared the ads from 1935 and 1950 
to determine if the value preferences stated for spouses varied over time. 
He hypothesized that socioeconomic characteristics (as opposed to personal 
characteristics) would be more important in the period immediately follow- 
ing immigration than they would be at a later period. Following a system- 
atic sampling and ceding procedure, he searched each advertisement to de- 
termine the order in which various spouse characteristics were mentioned. 
The data showed that socioeconomic factors in spouse selection were indeed 
higher and personal traits were lower in the early year than in the later 
year. 

During the last seven years, a handful of organization researchers 
have been working with the method, calling it either the case survey or the 
structured content analysis of cases. The modern era began with a group of 
researchers at the Rand Corporation (see Lucas, 1974). Yin and Yates (1975) 
content analyzed various cases to determine the attitudinal effects of urban 
decentralization. Gamson (1975) used the technique to study 53 protest 
organizations. Miller and Friesen (1977) investigated strategic decision- 
making in Fortune magazine. Yin et al. (1977) studies technological inno- 
vations. McDonald and Zellman (1978) evaluated the effects of ESAA funded 
non-profit corporations. Miller and Friesen (1980) researched 26 companies 
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for structural and strategy change. Jauch et al . (1980) studied execu- 
tive succession. Berger (1982) studied the stages of responses to en- 
rollment decline. 

The appeal of the case survey method is strong because it transforms 
qualitative evidence into quantitative statements. Until now, the main 
limitation of isolated, one-shot case studies was that the insights from 
the various cases could rot be asgregated in any systematic manner. The 
case survey overcomes this problem by integrating the individual studies 
via conventional statistics. Moreover, since case studies are in the 
public domain, data collection constraints (cost, access, and design) 
are minimized. Finally, the method is based on the assumptions that: 
(1) the case study is a legitimate sampling unit, (2) there is a meaning- 
ful population of cases from which one might generalize, and (3) selected 
aspects of the cases can be quantified. 

THE CASE SURVEY AND META-ANALYSIS 
By now, knowledgeable researchers have concluded that the case survey 
method sounds like secondary analysis, meta-evaluation, or meta-analysis. 
If it is true that secondar y analysis is "the re-analysis of data for 
the purpose of answering the original research question with better sta- 
tistical techniques or answering new questions with old data' 1 (Glass, 
1976, p. 3), then the case survey is secondary analysis. By the same 
token, if it is true that meta-evaluation involves Stuf f lebeam 1 s (1975) 
lotion of the evaluation of formative research and non-empirical evaluations, 
jthen the case survey is very similar to meta-evaluation. Finally, if meta - 
analysis refers to "the analysis of analyses, in other words, the statis- 
tical analysis of a large collection ox results from individual studies 
for the purpose of integrating the findings 11 (Glass, 1976, p. 3), then the 
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case survey is definitely a form of meta-analysis. 

Despite these apparent definitional similarities, the case survey and 
meta-analysis do differ. To explore the differences, we need to specify 
more precisely the meaning of meta-analysis. To its most eloquent advocate, 
meta-analysis is the ''statistical analysis of the summary findings of many 
empirical studies 11 (Glass, 1981, p. 21). Cook and Leviton (1980) agree. 
They see meta-analysis as a process where "studies relevant to a conceptual 
issue are collected, summary statistics from each study (e.g., means or 
correlations) are treated as the units of analysis, and the aggregate data 
are then analyzed in quantitative tests of the proposition under examina- 
tion" (Cook and Leviton, 1980, p. 445). 

In both definitions, meta-analysis refers to a collection cf experi- 
mental or correlational studies on a particular topic, where the quantita- 
tive findings of the various studies (differences in means, correlation 
coefficients and/or frequencies) are used as the dependent variable, and 
the substantive or methodological characteristics of the various studies 
are used as the independent variables. A classic example is the Glass and 
Smith (1976) study on the effects of psychotherapy. They found nearly 400 
controlled evaluations on the effects of psychodynamic, client-centered, 
behavior modification, and rat ional -emotive psychotherapy. Eschewing the 
traditional narrative review and voting method of meta-analysis, they con- 
verted the various outcomes to a common metric, known as "effect size, 11 
and conducted a quantitative analysis on the study's attributes. Their 
major impression was that the four types of therapy were not significantly 
different in their average impact. 

If we contrast the case survey method with this more precise meaning 
of meta-analysis, several differences emerge. First, where meta-analysis 

u 
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focuses on experimental or correlational studies, the case survey uses 
highly descriptive accounts of a phenomenon. Secondly, where meta-analysis 
attempts to account for study quality (although Glass, 1981 argues against 
the conventional wisdom that findings are in part determined by the quality 
of design), the case survey does not account for traditional threats to 
internal validity (Campbell and Stanley, 1966). 

Finally, where meta-analysis uses the statistical findings and 
methodological characteristics of the various studies, the case survey 
analyzes the content of the various cases according to the conceptual cate- 
gories of the case survey researcher. Thus, the findings of the original 
case writer may or may not be relevant to the goals of the case survey. 
For example, it is possible the case survey researcher is interested in 
community opposition to a school closure policy. While the original case 
writer may have focused on leadership under conditions of enrollment decline, 
and mentioned only casually the community's initiation of a lawsuit to pre- 
vent a school closure, the case survey researcher would use that particular 
case because it contained data on the community's reaction. 

These differences suggest that the case survey is like meta-analysis 
only when the meta-analysis concept is used in the most general way. If, 
however, meta-analysis is used to refer to the quantitative analysis of 
statistical findings, then the case survey is different. We now turn to 
a discussion of how the case survey is conducted, using the enrollment de- 
cline literature as a running example. 

— THE CASE SURVEY PROCESS AND APPLICATION 

The case survey method requires a case analyst to answer the same set 
of questions for each case study. The various questions are closed-ended 
to permit easy quantification. The basis for the questions is derived from 
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the policy literature and the researcher's own theoretical perspective. 

The process can be conceptualized in six basic steps: (1) definition 
of the unit of analysis; (2) identification of the case search strategy and 
case sources; (3) actual case search and selection; (4) checklist develop- 
ment; (5) checklist application to the cases; and (6) data analysis and 
interpretation. This process is no different than the process of primary 
research (Jackson, 1978). Since the goals of both the case survey and 
primary research are the same, namely, to make generalizations about phen- 
omena from diverse bits of information, it follows that these processes 
should be similar. 

Step 1; Definition of the Unit of Analys is 

The unit of analysis in a case survey is a site-specific description 
of the events which surround a phenomenon. Careful definition of the unit 
of analysis is essential because it delineates the consistent set of decision 
rules whereby a certain type of case is included in the study and others are 
ruled out. Cases can vary in terms of when the case was written, what or- 
ganizational events were described, what types of settings were studied, 
what constituted the level of analysis, and whether or not the case was 
published. 

Beginning in the mid-1970 f s, enrollment decline case studies appeared 
in the educational research literature. These highly descriptive cases 
were written by superintendents, education professors, consultants, and 
government officials. They focused primarily on what happened in a particu- 
lar district as the board of education, the community, and administration 
coped with the problems of enrollment decline. The nature of this litera- 
ture was as follows: [1) the cases were virtually the only empirical infor- 
mation available on the topic; (2) with very few exceptions, integration 
of the various cases was non-existent; and (3) where synthesis did occur, 
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it was usually based on a small number of cases. Thus, an application --f 
the case survey method to this literature seemed to be the natural next 
step to advance the state of knowledge about responses to enrollment de- 
cline. 

The study's unit of analysis was an enrollment decline experience in 
a case defined as "any. report or reports, written between 1971 and 1980, 
which described the organizational responses tu enrollment decline in a 
public elementary/secondary school district. 11 This definition ruled "in" 
multiple case descriptions on a single district and fugitive documents, 
such as task force studies or consultant reports. It ruled "out" cases 
writtten after 1980, private school decline experiences, responses to 
enrollment decline in higher education, and non-district level responses 
(e.g., how one school within a district weathered a closing decision). 
Published and unpublished cases were considered acceptable. 

Step 2: Identification of Case Search Strategy and Case Sources 
One of the most critical tasks of the method is the discovery of case 
studies. These units constitute the data base for the checklist items. 
Like the sampling process in primary research, here is where bias can 
• enter the study. It enters through the inclusion of cases which may be un- 
representative of the literature as a whole. Glass et al . (1981) argue that 
the best protection against this source of bias is a thorough description 
of the procedures used to locate studies so the reader can make an accurate 
assessment of the representativeness and completeness of the data base used 
-in the integration. The sources of case studies, in turn, determine the 
search strategy. 

To locate cases for the enrollment decline study, ten sources were 
identified: journals, dissertations, goverment agencies, bibliographies 
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(e.g., ERIC), papers from scholarly meetings, abstracts,, professional assoc- 
iations, education commissioners in the various states, AASA state presidents 
and private research organizations (e.g., Institute for Responsive Education) 
The:,? sources were searched systematically by the research team for case 
studies which fit the unit of analysis definition. In all, we reviewed 94 
journals a.v contacted 140 agencies, associations, and professionals by 
letter and/or telephone. The search included not only case studies but 
theoretical papers as well. These papers and their bibiliographies were 
used for possible leads to other case studies. 

Step 3: Actual Case Search and Selection 
Once the source of cases and search strategy have been determined, 
the actual process of search and selection can begin. Case search implies 
the reading of various case materials in light of the study's decision rules 
and applying the selection criteria. Based on the accumulation of cases 
and the explicit criteria which define the unit of analysis, the final set 
of cases is determined. This final set of cases becomes the study's popula- 
tion or, if a subset of this population is selected, the study's sample. 

About 250 enrollment decline documents were read. A total of 208 cases 
met the original criteria for selection. However, we noticed that some 
cases reported on the same district. We also noted that case studies varied 
from one or two pages of description to elaborate discussions of fifty pages 
or more. Faced with the issues of district duplication and case variation, 
we developed more precise selection criteria. 

— To deal with the duplication issue, we decided to treat all documents 
on a particular district as one and only one case. Some districts (e.g., 
Skokie, Illinois and Salt Lake City, Utah) have been described by several 
authors. This information was pooled for each district, thereby enriching 
the data base and providing a crude qualitative check on case validity. 
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To cope with the case variation issue, which implied missing data 
problems, the principal investigator read the 208 cases and distinguished 
those cases which had very little descriptive data from those cases 
which had good or excellent data (based on a quality assessment scale of 
0 to 3) , The documents receiving a "0 n or "1" score were typically theor- 
etical papers, prescriptive forecasting papers, aggregated state data or 
multi-district surveys. Case studies receiving a score of "2" or lf 3 n were 
descriptions which had substantial data on the study's major variables. 
This latter set of 70 cases comprised 33.7% of the original cases dis- 
covered (see Table I). 



Table I about here 

It is impossible to know whether the 208 total cases discovered com- 
prise the entire enrollment decline case literature. Multiple references 
to cases on file and our comprehensive search process led us to believe 
we were highly inclusive. It is important to note that the sampling pro- 
cedure was judgmental (or "convenient 11 as Jackson, 1978, states) rather 
than random. That is, we selected 70 cases on the presence of predetermined 
variables, rather than chance. Since it is unclear what portion of the 
literature was collected, and since the sampling procedure involved judg- 
ment, the hypothesis cf no bias cannot be ruled out. 

Step 4: Checklist Development 
The development of the checklist (i.e., the instrument used by the 
case analysts to survey each casej is usually begun concurrently with 
earlier steps, depending on the energy and resources of the researcher. 
Checklist development is similar to the construction of any instrument: 
variables of interest are identified and scaled in a closed-ended fashion 
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to permit quantitative analysis. To the extent that variables can be 
grouped in logical categories and scaled in realistic values, the sub- 
sequent application of the checklist to the individual cases is facili- 
tated. 

The process of checklist development in the enrollment decline study 
occurred in tandem with the case search activities. After consultation 
vith several enrollment decline experts and a review of the theoretical 
literature, the research team generated about 300 variables and their 
operational definitions. These variables were reduced to 227 and placed 
in the checklist under the following conceptual categories: (1) nature 
of the district study; (2) community dempographics; (3) district character- 
istics; (4) nature of the enrollment decline response; (5) school board 
role; (6) administration role; (7) professional st3ff role; and (8) com- 
munity role. When the checklist was completed, it was ready for applica- 
tion to the final set of 70 cases. 

Step 5: Checklist Application to the Final Set of Cases 
Checklist application requires two preliminary .steps. First, case 
analysts need training on tue content of the checklist and secondly^ they 
must practice the process by which the checklist is applied. Training 
is critical because multiple meanings and ambiguities are inevitable. 
This is especially true with items that call for case analyst judgment 
rather than the recording of numerical data. 

Clarity and consistent interpretation of the various items are the 
-goals of checklist training. In terms of the process of application, case 
analysts will vary in their style. Some analysts like to read an entire 
case several times and fill out the checklist at the end, whereas other 
analysts prefer to fill out the various questions as they read. Whatever 



Studying Enrollment Decline 13 

the preference, case analysts should practice on several cases before 
actual coding begins. Once the case analysts are familiar with the 
checklist and comfortable with the process of application, the -actual 
checklist application process can begin. It continues until one checklist 
is completed for each district. 

During several sessions, the enrollment decline case analysts were 
instructed in the nature and uses of the checklist. The various items were 
explained and analysts were given an opportunity to clarify their under- 
standing and to practice checklist application. Since the case analysts 
were graduate students knowledgeable about enrollment delcine, training 
and practice were rather straightforward. When training was completed 
the 70 cases were distributed randomly among the analysts. The 70 
checklists became the study's data base. 

Step 6: Data Analysis and Interpretation 
With the checklists completed, the researcher is now ready for data 
analysis and interpretation. Analysis is facilitated through the use of 
multivariate statistics. The main goal of the case survey is to transform 
isolated, qualitative judgments from disparate cases into quantitative 
statements about the case literature as a whole. It seems neither possible 
nor feasible to make such statements without the help of statistical methods 
(Glass et al., 1981). Typical statistical tests include univariate descrip- 
tion, frequency analysis, correlation, regression analysis, factor analysis, 
analysis of covariance, and/or discriminant analysis. 

Whi\e the case survey provides quantitative integration and increases 
the generalizability of isolated case studies, it is not without its metho- 
dological problems. Specifically three problems seem to be inherent in 
the method: establishing case validity and inter-analyst reliability, 

ERLC 1 b 



Studying Enrollment Decline 14 

evaluating case quality, and overcoming missing data problems. 

The question of validity refers to the relationship between each 
checklist item and the concept it attempts to measure, and the . 
case study and the reality it attempts to describe. On both counts, the 
case survey is particularly vulnerable. In terms of the former problem, 
items on the checklist rarely exceed face validity. In terms of the 
latter problem, the case survey fares no better. Jauch et al . (1980), for 
example, dismiss the issue entirely by stating that it awaits further in- 
vestigations. The Miller and Friesen (1980) study is one notable exception. 
They surveyed 26 published corporate histories and attempted to correlate 
their checklists with responses on a separate questionnaire sent to twelve 
firms whose executives were knowledgeable about the events described in the 
cases . 

Reliability is a concern in the case survey because the checklist 
quantifies, classifies, and codes the characteristics and descriptive 
accounts of various case studies. Jackson (1978) points out that when the 
number of studies and items is relatively small, coding can be done by a 
single investigator, and hence, remains fairly consistent. But if many cases 
are coded, and they are coded over time, serious threats to coding stability 
may occur. In more precise terms, measurement unreliability is likely to 
occur when different case analysts fail to see or fail to judge case events 
in the same way. The problem is usually resolved by having more than one 
analyst fill out a checklist on the same case. The amount of inter-analyst 
agreement becomes the measure of reliability (Yin and Heald, 1975). 

Variation in case quality is also a problem in case survey research. 
This usually comes from the meta-analysis notion that the findings of 
poorly designed studies are often combined with the findings of "good 11 
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studies, while aggregated conclusions should only be based on the findings 
of "good" studies (Cook and Gruder, 1978) . Concern about quality may also 
occur if there is "selection bias" in the original collection of cases 
(e.g., cases chosen from only academically-oriented journals). 

In the enrollment decline study, validity of the various checklist items 
was not checked empirically. Experts did assert that the various items had 
face validity, but no further quantitative analysis was conducted. Relia- 
bility, on the other hand, was verified empirically. Reliability was defined 
as the degree of consistency between two checklists on the same district, 
each completed by a different case analyst. This is similar to reliability 
on a psychological or educational instrument when the researcher is interested 
in the stability of a person's score under slightly different conditions. 

To estimate reliability, researchers typically use a test-retest, 
equivalent forms, or split-half technique, A test-retest estimate is 
obtained by administering a test to a group of individuals, re-administering 
the same test to the same group at a later date and correlating the two 
sets of scores. In contrast, the equivalent forms estimate is obtained* by 
giving two forms of a test to the same group on the same day and correlating 
these sets of scores. The split-half method is basically a variation of 
equivalent forms; instead of administering an alternate form, only one test 
is administered and an estimate of reliability is obtained by taking two 
halves of thk test and correlating them. To estimate reliability for the 
entire test, a correction factor is applied using the Spearman-Brown prophesy 
formula (see Mehrens and Lehmann, 1973, p. 114): 

2ri^ 

r xx = — 

1 + ri^ 

where r xx = estimated reliability for the entire test 

rj^ = correlation coefficient for the half-test. 

J 3 
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The present study used a variation of the split-half technique. The 
advantage of this procedure was that it required only one form of the check- 
list. A random sample of 36 of the 70 cases (51.4%) was chosen. Two analysts 
read each case independently and completed a checklist (see Yin et al., 1977; 
Miller and Friesen, 1980; and Jauch et al., 1980 for a similar procedure) . 
After selecting a random sample of 50 checklist items for the reliability esti- 
mate^ Pearson's product moment correlation coefficient was calculated for 
the two raters across the 36 cases. The correlation was .64. To estimate 
reliability for the entire checklist, the Spearman-Brown prophecy formula 
was applied as follows: 

2(.64) 1.28 
r xx = 1 ♦ .64 = 1.64 = ,78 

Thus, with an inter-analyst correlation coefficient of .64, the estimated 
reliability for the entire checklist was .78. Jauch et al. (1980) suggest 
that a Spearman-Brown reliability coefficient of at least .67 is adequate 
for questionnaires, and hence, case survey research. 

The issue of quality refers to the possibility that the final set of 
70 cases was biased in some.way. Bias may be present as a result of the 
sampling procedures. The cases in this study were selected if they con- 
tained the study's variables of interest. Thus, there is no way to esti- 
mate whether the final set of 70 cases was representative of the entire 
case literature or of school districts as a whole. 

The missing data problem is also implied in the issue of quality, 
jite attempts to select cases which contained most of the variables, the 
- number of variables on the checklist, and the disparate cases meant 
that Jiis study suffered from missing data problems. At this. point the 
researcher is faced with a decision: delete cases from the analysis which 
lack data, or pursue missing data in order to retain a high number of cases. 

o id 
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For this study, we developed an elaborate follow-up process. Reasoning 
that missing data could be collected through a little detective work, we 
conceived a strategy that would supply missing data by contacting the 
original case writer, local newspaper education reporters, or the dis- 
trict itself. This collection process was suggested in Yin et al. (1979). 
When information could not be located, the checklist item was marked "Im- 
possible to say" and deleted from the computer analysis. 



Table II about here 

The final set of 70 cases was composed of the following community types: 
24 urban, 35 suburban, and 11 rural (see Table II). Two particular questions 
from the original study will illustrate data analysis and interpretation. 

1 . Do school districts experiencing enrollment decline delay the 
timing of their first school closing ? 

Despite the fact that numerous authors have written on the volatile sub- 
ject of school closings, there has been very little work on when the consoli- 
dation of schools is likely to occur. One can hypothesize that closings are 
sufficiently controversial that districts will put them off as long as possible. 
A checklist item was included to identify the year a district closed its first 
school and a Chi-square statistic tested the assertion that the observed dis- 
tribution of first closures did not differ over time (p<.05). To standardize 
the cases, the analyst determined the year of peak enrollment (PE) in the dis- 
trict. Data were then collected in two year intervals, up to PE ♦ 10. The 
frequencies appear in Table III. 

Table III about here 
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The data in Table III show 59 valid cases. The expected frequency 
of first closures per year was 11.8 (.20 x 59). The calculated Chi-square 
statistic was 1.23, with a critical value of 9.48 (.05 level and 4 degrees 
of freedom). Thus, the null hypothesis of no differences between observed 
and expected frequencies could not be rejected. School districts in this 
study were equally likely to close their first schools early as well as late 
in their decline cycle. The assertion that school districts will delay the 
timing of their first closing is not supported in this context. 

2 - What is the impact of enrollment decline and certain structural 
characteristics of a district on per pupil costs ? 

It is well within the conventional wisdom that enrollment decline 
creates financial stress for the district. Cuban (1979) used the two -armed 
pincers metaphor to describe the problem. On arm is demographic changes 
(i.e., enrollment decline) and the other arm is rising costs. Combine in- 
flation with less revenue coming in (as a result of declining enrollment) 
and the pincers squeeze the district. While it is assumed that enrollment 
decline has a critical impact on per pupil costs, the exact nature of this 
effect, as well as the impact of various structural factors on per pupil 
costs, have rarely been estimated. 

Six variables were used to shed some light on these issues (see Table 
IV). The dependent variable, per pupil costs in PE + 10, typically included 
teacher, staff, and administration salaries, supplies, maintenance, trans- 
portation, fixed charges (Social Security), and debt service. This cost 
figure was adjusted for inflation, using the consumer price index for that 
district. The enrollment decline rate was measured from PE to* PE ♦ 8. The 
school consolidation rate looked at the number of buildings alone and, hence, 
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is the number of schools in the district in PE, minus the number of schools 
in PE + 8, divided by the number of schools in PE. The pupil-teacher ratio 
is the number of pupils divided by the number of teachers. The average 
school utilization rate is the number of students per school in PE, minus 
the number of students per school in PE + 8, divided by the number of 
students per school in PE. Finally, the pupil-administrator ratio is the 
number of students divided by the number of administrators (including 
principals) . 



Table IV about here 



Table V about here 

Table V indicates that for the combined sample, the five predictor 
variables explain almost 30 ? o of the variance in per pupil costs. Of the 
five predictors, however, only decline rate (p<.01) and pupil-teacher 
ratio (p<.001) were significant. Moreover, the signs on both beta weights 
are negative (-.36 and -.45, respectively). While it is expected that the 
relationship between the pupil-teacher ratio and per pupil costs would be 
negative (that is, the higher the pupil-teacher ratio the lower the per 
pupil costs, as a result of economies of scale), it is curious that decline 
rate has a negative rather than a positive effect on per pupil costs. The 
finding is that the higher the decline rate, the lower the per pupil costs, 
holding other factors constant. This contradicts the conventional view 

r 

that the higher the decline rate, the higher the per pupil costs. 

The anomaly may be explained" by remembering that declining enrollment 
increases costs if, and only if, it fails to precipitate cutbacks in facili- 
ties, programs, and staff. Whether such cutbacks occur probably depends 

22 
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on the level of fiscal stress in a district brought on by enrollment decli] 
The level of fiscal stress, in turn, depends on state funding formulas 
and changes in district wealth or taxing policies. Thus, lower. per pupil 
costs could be associated with higher ratios of decline if a district cuts 
its expenditures faster than enrollment falls. For example, since the 
rate of teacher cutback was not measured in this analysis, this factor 
could be moderating the decline rate/per pupil cost relationship. 

ANALYSIS OF THE CASE SURVEY METHOD 

The case survey approach involves placing the data from descriptive 
case studies into a closed-ended checklist and analyzing the checklists 
from many cases via conventional statistical techniques to determine 
the relationships between the variables of interest to the researcher. 
Clearly, the case survey method has a number of strengths. First, it is 
a systematic, explicit method of integrating a diverse set of case mater- 
ials. Second, because it focuses on the utilization of existing know- 
ledge, it may be less costly for some policy issues than the production 
of primary research. Third, because case materials are in the public 
domain, the method avoids certain access and data collection problems. 
Fourth, through the use of multivariate statistics, the method permits the 
investigation of relationships between variables when the nature of the 
problem or legation of the data preclude an experimental or quasi-experi- 
mental design. Finally, the case survey permits a more generalizable 
conclusion than the single case study. 

This is not to say that the method is without problems. In addition 
to the three troublesome issues discussed earlier, Jackson (1978) has 
argued that when multivariate statistics are used, the set of original 
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studies must be large because the standard errors of both the R and partial 
regression coefficients are the inverse function of N-K-l, where N is the 
number of cases and K is the number of predictor variables (Kerlinger and 
Pedhazur, 1963, p. 62-67). When the N is small, the standard errors of 
the partials will be large and will overestimate the population parameter. 
Kerlinger and Pedhazur (1973, p. 282) suggest at least 30 cases for each 
predictor. Finally, while it may be true that the case survey permits 
generalization beyond any one particular case study, generalization should 
be made to the case study literature, rather than to all districts. 

IMPLICATIONS 

What are the implications of the case survey method for future educa- 
tional research .and development? The first and obvious implication is to 
apply the method to other case literatures. While meta-analysis has 
focused on studies with quantified findings, the case survey can be used 
in those policy areas where one-shot, idosyncratic case studies need 
integration. Such literatures include educational administration, educa- 
tional policy, and program evaluation. 

The second implication is to refine the method itself. Like any new 
"technique, the case survey has many unresolved problems which may threaten 
its ultimate utility. Work is needed to improve the establishment of 
validity, to distinguish quality cases, to overcome missing data problems, 
and to refine checklist development and application procedures. Without 
further work on the case survey, its positive features may be overlooked 
and a promising integrative strategy set aside. 

A final implication has to do with the training and development of 
future educational researchers. Researchers tend to distinguish themselves 
as qualitative case study types, on the one hand, and quantitative experi- 
mentalists, on the other hand. Typically, the distinction is more a func- 
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tion of the researcher's level of comfort with statistics than anything 
else. Those researchers who shy away from the "crunching of numbers' 1 
tend to prefer qualitative studies, while those trained in tf harder" methods 
prefer the experimental approach. The bifurcation is indeed unfortunate. 
It undermines the legitimacy of the M other ,? method and leads to a search 
for problems and research techniques which are suited to the researcher's 
technical competence. Until now, there Were few occasions to integrate 
the skills and strengths of both research perspectives. 

With the development of the case survey, the training and development 
of future researchers can incorporate a set of skills (and a perspective) 
that broadens rather than narrows research competence. The case survey 
forces the researcher to come to grips with the importance of a good, 
qualitative analysis, and at the same time to become skilled in the assump- 
tions and techniques of survey and multivariate techniques. Ideally, 
the researcher would be trained from the starting point of case development 
to the endpoint of the analysis of many cases. 

CONCLUSION 

The purpose of this paper was to describe the case survey method 
for overcoming data collection constraints and difficulties with many 
unintegrated case studies. More specifically, the aim was to outline 
the roots of the case survey, to distinguish it from meta-analysis, to 
describe the basic process and apply it to the enrollment decline case 
literature, to evaluate its strengths and limitations, and to suggest 
some implications for future research and development. 

The case survey should be viewed as one method for improving the 
quality and generalizability of one-shot case studies. It is not the 
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only answer to the problems of conducting research. Rather, it is a 
tool and as such, it has appropriate and inappropriate uses. Whether 
it will be useful, however, depends on more development and application. 
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TABLE I 

Assessment of Cases for Final Set 



Rating Number Percentage 

of Cases 



0 or 1 138 66.3 

2 or 3 70 33.7 

208" 100.0% 
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Community Distribution of the Final Set of Cases 
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Urban Districts 
(n = 25) 



Suburban Districts 
(n = 34) 



Rural Districts 
(n = 11) 



California: Haywood, Palo 
Alto, Santa Barbara 

Colorado: Englewood 

Connecticut : Hamden 

Illinois: North Chicago, 
Pekin 

Massachusetts : Boston 

Michigan: Grand Rapids 

Minnesota: #2, #5 3 

Missouri: Kansas City, 
St. Louis 

New York: East Syracuse, 
Yonkers 

Ohio: Berea, Euclid, 

Lakewood, Steubenville, 

Oklahoma: Tulsa 

Oregon : Eugene 

Tennessee: Nashville 

Utah: Salt Lake City 

Virginia: Richmond 

Washington, Seattle 



California: Berkeley 

a a 
Illinois : Alton, Camden * 

Deerfield, Elmhurst , 

Glencoe, La Grange, Le- 

land f a Mt. Prospect, 

Northview, 3 Oakton, 

Oregon, Shabbona, Skokie, 

Trenton, 3 Weston 

Maryland: Montgomery County 

Massachusetts: Lexington, 
Natick, Newton, 

Michigan : Birminghan, 
Livonia, Oakpart 

Minnesota: #1 

New Jersey: Bridgeton 

New York: Arbutus, 3 
Clarence, East Meadow, 
Great Neck, Karlin, 3 
Mamaroneck, White Plains 

Pennsylvania: South Alle- 
gheny 

Virginia : Arlington 



Illinois : Champaign, 
Pawnee -Divernon 

Indiana : Monroe 
County 

Iowa: Cal Community 
District, Lohr- 
^ville 

Ohio: Bradford, 
Fai rborn , Franklin 

Oklahoma: Blackwell 

Minnesota: #3, #4 3 



Notel'The terms suburban and rural were at times applied based on proximity to urban 
centers rather than population. For example, some districts (e.g., Skokie, Illinois 
and Montgomery County, Maryland) are large in size but are adjacent, to urban centers. 
They were categorized as suburban. Other districts (e.g., Grand Rapids, Michigan and 
Steubenville, Ohio) are smaller in size but are relatively industrialized and inde- 
pendent of any larger, nearby city and are categorized as urban. 

a District names are pseudonyms used by the original case authors. 
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TABLE III 

Frequency Analysis of the Year of First Scl il Closing (N =• 70) 



Year after Peak Observed Relative Adjusted Relative 

Enrollment (PE) Number of Frequency Frequency (N=59) 

Districts (%) (%) 

Closing Schools 

for First Time 



PE + 2 


15 


21.4 


25.4 


PE + 4 


11 


15.7 


18.6 


PE + 6 


12 


17.2 


20.4 


PE + 8 


10 


14.3 


17.0 


Ph + 10 


11 


15.7 


18.6 


Impossible to say 


11 


15.7 


Missing 


TOTAL 


70 


100.0 


100.0 
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TABLE V 

Regression of Per Pupil Cost on Antecedent Variables 



Independent Standard Partial 

Variable Beta Error F-ratio 



1. 


Decline rate 


-.36 




1.29 




4.26* 


2, 


Consolidation rate 


.25 




• 64 




1.66 


3* 


Pupil-teacher ratio 


-.45 




.02 




7.13*» 


4. 


School utilization rate 


-.02 




.78 




0.01 


5. 


Pupil-administration ratio 


-.13 




• 23 




0.56 








R2 


- .298; 


d£ « V2B 










T 


- 2,29, 


K.S. 





• p<.01 
*»p<.001 



